Empirical analysis of practitioners' perceptions of test flakiness factors

Identifying the root causes of test flakiness is one challenges faced by practitioners during software testing. In other words, testing hampered flakiness. Since research about in large-scale engineering scarce, need for an empirical case-study where we can build a common and grounded understanding problem as well relevant remedies that later be evaluated context necessity. This study reports findings from multiple-case study. The authors conducted online survey to investigate catalogue mitigation strategies. We attempted understand how perceive closed-source development, such they define what affect perceptions were compared with available literature. investigated whether practitioners' are reflected artefacts relationship between perceived factors properties artefacts. reported 19 professionals These categorized code, system under test, CI/test infrastructure, organization-related. concluded some development directly related non-determinism, whereas concern different aspects, example, lack good case, deviations established processes, ad hoc decisions. Given data set cases, two (i.e., case size simplicity) have strong effect on